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Abstract 

Aim: Sigma measurements are a standard tool for quality assessment of test performance in a laboratory. In this study, we aimed to calculate sigma metrics 
and quality goal index (QGI) for 28 biochemical parameters. Sigma values of each assay were calculated, based on the bias and coefficient of variation from 
internal quality control (IQC) and external quality assurance scheme (EQAS). 

Material and Methods: External quality assessment (EQA) and internal quality control data for 28 parameters in a biochemical laboratory were collected from 
July 2019 to February 2020. The sigma values of each assay were calculated, based on the bias, total error allowable, and coefficient of variation, according to 
the quality goal index, the main causes of poor performance were determined to guide quality improvement. This study was conducted in the Haseki Training 
and Research Hospital Biochemistry Laboratory. Sigma metrics calculation was performed as (TEA - Bias)/CV for 28 biochemistry parameters analyzed with 
AU5800 [Beckman Coulter (BC), USA]. Total allowable errors were followed as per Clinical Laboratory Improvement Amendments (CLIA) guidelines. 

Results: At IQC 1, eight of the 28 parameters (AST, ALT, LDH, CK, ALP, HDL, T. Bil 

and D. Bil) showed world-class performance. At IQC 2, three of the 28 parameters (ALP, T.bil, and Crea) achieved 6 sigma (world-class performance), and 
three parameters (Amilase, K, Cl, and Lipase) showed world-class performance for EQC. The quality goal index (QGI) was calculated for items with analysis 
performance < 3 sigma, and the main causes of poor performance were determined to guide quality improvement. 

Discussion: Sigma metric analysis provides a benchmark for the laboratory to design a protocol for IQC, address poor assay performance, and assess the 
efficiency of the existing laboratory process. Six Sigma methodology is an effective tool for evaluating the performance of biochemical analytes and conducive 
to quality assurance and improvement. The quality goal index is a calculation that complements this method. 
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Introduction 

Medical Laboratories must produce accurate, precise, and 
comparable results for correct diagnosis and treatment 
practices. For this purpose, each of the preanalytical, analytical, 
and post-analytical processes must be continuously checked 
and improved. The purpose of clinical laboratory tests is to 
support the diagnosis, monitor treatment, and assess the 
risk of disease progression. To have value for creating clinical 
conclusion, an individual laboratory test result must have 
a total error small enough to reflect the biological condition 
being assessed [1]. Also, clinical laboratory testing results are 
important for ensuring patient safety. Approximately two-thirds 
of important clinical decisions on patient management are 
based on laboratory test results [2] 

In clinical laboratories, medical technologists are trained 
to focus on achieving Quality Control (QC) results within the 
defined acceptable limits [3]. The “Six Sigma Methodology” is 
a quality management tool based on statistical calculations, 
focused on process variables, and providing information about 
the procedure. The sigma value of a test is a well-defined and 
quantitative measurement of the quality of this test. Six Sigma 
is a quality management method to improve assay quality. The 
sigma methodology has mainly been applied to pre-analytical 
and analytical processes in clinical laboratories, focusing on the 
evaluation of biochemical and immunoassay tests. The higher 
the sigma values, the lower the chance of false test results by 
the laboratory. It can easily quantify the exact number of errors 
by combining bias, precision, and total allowable error (TEa). A 
sigma level < 3 is an indication of a poor performance procedure, 
whilst good performance is indicated by a sigma level > 3. A 
Sigma level of 6 or greater indicates world-class performance 
[4]. In this study, we aimed to evaluate our laboratory analytical 
performance with the Clinical Laboratory Improvement 
Amendments (CLIA) criteria performance (available at: https:// 
www.cms.gov/Regulations-and-Guidance/Legislation/CLIA). 
The quality goal index (QGI) is a newer parameter to represent 
the relative extent to which both bias and precision meet their 
respective quality goals [6]. In this study, the performance of 
28 analytes was evaluated by calculating sigma values from 
coefficient of variation (CV), bias, and TEa. In addition, QGI 
analyses were further performed to identify problems related 
to the measurement procedures for analytes with a sigma value 
<3 [7] 


Material and Methods 

This is a retrospective study, and the data required for the 
study were extracted between July 2019 to February 2020 
in the Haseki Training and Research Hospital Biochemistry 
Laboratory. Sigma metrics calculation was performed as (TEA - 
Bias)/CV for 28 biochemistry parameters analyzed with AU5800 
[Beckman Coulter (BC), USA]. The CV was calculated based on 
IQC data (BC control serum two-level/one run per day). 

This study included the following 28 clinical biochemistry 
parameters: Albumin(Alb), Alanine Aminotransferase (ALT), 
Alkaline phosphatase (ALP), Aspartate Aminotransferase 
(AST), Amylase (Amy), Anti-streptolysin-O (ASO), Iron (Fe), 
Unsaturated Iron Binding Capacity (UIBC), Direct Bilirubin (D.Bil), 
Phosphorus (P), Calcium (Ca), Chloride (Cl), Total Cholesterol 


(T.Chol), Creatinine(Crea), Creatine Kinase (CK), Glucose (Glu), 
Gamma-Glutamyl Transferase (GGT), High-Density Lipoprotein 
(HDL), Lactate Dehydrogenase (LDH), Lipase 
(Lps) , Magnesium (Mg), Potassium (K), Total protein (T.prot), 
Total bilirubin (T.bil), Sodium (Na), Triglycerides (Trig), Blood 
urea nitrogen (BUN), Uric acid (UA). The sigma metrics were 
calculated by the following formula: [Sigma = (TEa - Bias)/CV] 
[8]. Whereas TEa is a total allowable error, and bias and CV are 
the indicators of systematic and random errors, respectively. 
QGI represents the relative extent to which both bias and 
precision meet their respective quality goals. It was calculated 
using the following formula: [QGI = Bias/1.5 CV]. QGI represents 
the reason behind the lower sigma value i.e., imprecision, 
inaccuracy, or both. For analytes that fall short of Six Sigma 
quality, a QGI score of < 0.8 indicates imprecision, QGI > 1.2 
indicates inaccuracy, and QGI score of 0.8-1.2 indicates both 
imprecision and inaccuracy [8]. 

CV is the standard deviation (SD) expressed as a percentage 
and is a measure of the variability of an assay [CV = (SD/Mean) 
x (100)]. 

Bias is the systematic difference between the expected results 
obtained by the laboratory test method and the results that 
would be obtained from an accepted reference method. 

TEa was followed as per the CLIA guidelines (Clinical Laboratory 
Improvement Amendments (CLIA) | CMS). The total error (TE) of 
parameters was also calculated by the following formula: [TE = 
Bias + 1.65 CV] [7]. 


Cholesterol 


Results 

The bias %, CV%, TEa, sigma, and QGI values of clinical 
chemistry tests are shown in Table 1. Sigma values calculated 
with TEa, bias, and CV are shown in Table 2. The QGI according 
to sigma values are provided in Table 3. 

While IQC eight analytes (AST, ALT, LDH, CK, ALP, HDL, T.Bil 
and D.Bil ) showed an ideal performance of =6 sigma for level 
1; five analytes (T.prot, UIBC, Alb, Chol, and Lipase) showed an 
average performance of <3 sigma for IQC 1. Also, IQC three 
analytes (ALP, T.bil, and Crea) showed a performance of =6 
sigma for level 2; five analytes (T.chol, Alb, P, Fe, UIBC, and 
Lipase) showed an average performance of < 3 sigma for level 
2. Sigma values of BUN, Glu, AST, Alb, Fe, and HDL were below 
3 for EQA. Sigma values Amilase, K, Cl, and Lipase were = 6 for 
EQA. Sigma values of Glu, BUN, UA, Crea, Trig, AST, Amilase, 
Ca, P, Mg, Na, K, Cl and ASO were in the range of 3 to 6 For lQC 
1. Sigma values of Glu, BUN, UA, Crea, Trig, AST, Fe, Na, D.bil, 
Amilase, Ca, Na, K, Cl, HDL, ASO and Lps were in the range of 3 
to 6 for IQC 2. Also, EQC fourteen analytes (Crea, Trig, ALT, GGT, 
CK, LDH, CK, ASO, T.Bil ,D.Bil, Aml, Ca, P, Mg, UIBC) showed a 
performance in the range of 3 to 6 sigma .Sigma value > 6 was 
found, ALP T-Bil and LDH for both levels of IQC. Sigma values 
of UIBC and T.chol for both levels of |QC were lower than 3. But 
EQAs of these tests were in the range of 3 to 6. 

Table 3 summarizes the QGI ratio of analytes with lower 
sigma values (< 3). The quality goal index (QGI) was calculated 
for items with analysis performance <3 sigma and the main 
causes of poor performance were determined to guide quality 
improvement. QGI ratio indicated that out of three and four 
parameters of IQC1 and IQC2 failed to meet Six Sigma quality 
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Table 1. The average CV %, average bias %, TEa (CLIA), calculated TEa, sigma metrics, and QGI of the 27 parameters for level 1 
and level 2 internal controls. 


Bias% TEa(CLIA) 
Analytes 
Level 1 Level2 Level 1 Level2 Level1 Level2 Level2 Level 1 Level 2 Level 1 Level 2 

Glucose 2,95 2,23 1,08 3,07 5,95 6,75 10 3,02 5,86 0,24 0,92 
Urea 551 3,05 21 0,63 7,9 44 9 3,16 3,16 04 0,14 
Uric Acid 2,65 4,22 6,77 5,75 11,14 11,22 17 3,86 5,39 ? 0,91 
Creatinine 521 27 1,63 0,18 6,92 3,76 15 417 6,83 0,34 0,34 
Cholestrol 2,35 3,44 4,54 1,59 11,72 12,22 10 2,32 2,44 1,29 0,31 
Trigliserid 2,95 455 1,13 1,51 6 6 15 47 3,63 0,26 0,22 
AST 2,95 3,42 1,6 5,19 6,46 10,84 20 6,24 4,33 1 0,45 
ALT 2,87 401 2,26 1,33 2,47 5,29 20 7,76 532 0,53 0,22 
GGT 2,32 2,32 4,13 3,47 73 4,04 15 497 43 1 0,45 
LDH 2,95 6,3 2,78 1 2,09 11,4 20 T72 3,02 0,26 0,06 

CK 2,73 4,63 2,26 0,86 2,24 6,78 20 815 4,51 0,79 0,12 
ALP 3,43 51 741 9,65 175 1,24 20 7,99 rei) 0,02 1,26 
T.protein 4,77 4,93 ays 0,67 IA2 7,46 10 2.25 31 0,1 0,2 
Albumin DP 43 3,48 0,1 0,15 Thi 10 6,13 2,33 1,05 0,54 
Tot. Bil 2,95 3,47 1,08 5,41 5,95 0,31 20 6,41 732 0,24 1,04 
Dir. Bil 2,08 3,88 1,64 2,76 1,79 3,64 15 8 4,58 0,53 0,47 
Amylase 2,09 4,68 WI 04 11,22 7,32 20 5,85 4,36 2,48 0,06 
Calcium(Ca) 431 3,76 6,22 4,24 0,89 1,96 11 4 4,05 0,96 0,75 
Phosphor 32 a 09 0,98 4,38 7,44 10 34 2,15 0,19 0,13 
Magnesium 401 4,82 3,02 (e) 9,64 7,95 25 5,48 5,19 0,5 0,01 
Iron (Fe) 5,19 6,86 3,69 0,07 28,75 12,9 20 3,26 2,55 0,16 0,01 
UIBC 1,07 5,19 17,07 722 20,49 15,78 20 2,74 2,46 55 0,93 
Sodium (Na) 1,79 2,68 0,65 0,84 2,31 3,58 10 5,95 4,04 0,24 0,21 
Potassium(K) ipoal 2a (e) 1,64 2,82 5,13 10 5,85 3,96 (0) 0,52 
Chloride (Cl) 1,62 1,89 4 1,15 6,67 4,26 10 37 4,68 1,65 0,4 
Lipase 5,14 5,67 20,81 1,37 29,29 10,73 30 Ay 5,05 27 0,16 
HDL 4,95 5,07 15,86 9,18 Pe 0,82 15 6,24 4,77 2,14 123 
ASO yes 3,33 9,93 1,51 14,42 20 a7 555 2,43 0,3 


Table 2. Sigma values according to internal and external Table 3. Quality goal index ratio of analytes sigma performed 
quality control low accuracy and precision problem. 


Sigma<3 Sigma>6 Sigma 3 -6 


Analytes Qc Levels Cv% Bias% Sigma Problem 


UIBC 10C 1 1,07 17,07 2,74 1,5 Inaccuracy 
Lps 10C 1 5,14 5,81 Di ey Inaccuracy 
Tchol 10C 1 235) 4,54 2,32 1,29 Inaccuracy 
Alb 10C 2 (0) 43 2,38 0,54 mprecision 
Fe 10C 2 6,86 0,07 2,55 0,01 mprecision 
P 10c 2 5) iI 0,98 AL SY 0,19 mprecision 
UIBC 10C 2 5,19 7,22 2,46 0,93 imprecision 
and inaccuracy 
Glu EQC 3,56 2,62 Zon 0,49 mprecision 
Pp Crea 
U EQC 3,32 141 2,29 0,28 isi 
fa An # ig K Q mprecision 
UIBC : ALT cl AST EQC 3,38 1,36 2,13 0,27 mprecision 
GGT HDL 
LDH ASO Alb EQC 2,74 1,51 2,31 0,37 mprecision 
CK Lps 
P Fe EQC 48 PANS) 1,92 0,03 mprecision 
HDL EQC 48 1,22 1,21 0,03 mprecision 
Crea T. Bil 
acc Tri D.Bil 
AST K pee = performances. The main problem was an inaccuracy in the case 
a 
Alb cl : : oe 
es Chea LDH P of UIBC, lipase, and total cholesterol (QGI > 1.2), imprecision in 
CK Mg : 8 
npr ASO UIBC the case of Alb, P, iron level 2 (QGI < 0.8), and both imprecision 


and inaccuracy for UIBC (IQC2). 
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Discussion 

Good laboratory practice (GLP) requires every individual 
laboratory to design a customized Individualized Quality 
Control Plan (IQCP), a protocol based on Sigma values obtained 
from Sigma metric analysis (ISO - ISO 15189:2012 - Medical 
laboratories -Requirements for quality and competence. 
Available at: https://www.iso.org/standard/56115.html). The 
incorporation of sigma metrics results in the reduction of 
laboratory errors by maintaining six standard deviations 
between the parameter average and its upper and lower limits 
[9]. 

Nanda et all. determined that six sigma values were greater 
than 6 for some routine biochemistry tests (AST, ALT, ALP, total 
bilirubin, and uric acid) on Cobas Integra analyzer. Sigma values 
less than 3 were calculated for total protein, albumin, total 
cholesterol, and chloride tests in their study [10]. When these 
data are compared with our study, it is seen that a sigma value 
less than 3 is calculated for Alb and UIBC. T.prot and Cl are 
greater than 3 in our study. Sigma value was found to be less 
than 3 for albumin in both studies. But EQAS results were good 
for both of them. 

Parameters with low sigma values should be improved with 
a strict QC strategy. The six-sigma concept is important in 
controlling the quality of laboratory tests [10]. Total analytical 
errors may differ according to accepted error classifications 
such as Richos, Rilibak, CLIA [11]. However, sigma metric 
evaluation can be more objective because it is obtained from 
systemic and randomized error values, bias, and standard 
deviation [12]. In our study, unlike other sigma’s metric clinical 
chemistry analyzes, we also calculated the quality target index. 
Our aim here was to identify the problem. Unlike previous 
studies, we calculated the QGI in tests with sigma values. We 
have considered their total analytical error value. UIBC, lipase, 
Fe, P, and total cholesterol were short of sigma metrics with a 
value < 3. QGI ratio for parameters with sigma < 3 depicted 
inaccuracies in the case of total cholesterol, UIBC, and lipase 
(QGI > 1.2), imprecision in the case of tests Albumin, lron and 
Phosphor (QGI < 0.8), and imprecision and inaccuracy in the 
case of UIBC level 2. There are certain limitations in the sigma 
metrics system because we have observed no problems in 
the CV % and bias % of glucose (level 2), urea (level 2), and 
total cholesterol (level 2 and level 3), but sigma shows a lesser 
value. In the case of AST and ALT, the calculated TEa is higher 
compared to the allowable error as per CLIA, which is reflected 
in the QGI and sigma metrics. The tests we analyzed in the 
biochemistry laboratory were below total analytical error values 
according to CLIA. This showed us that each laboratory should 
also perform sigma analysis besides TEA values. We also tried 
to identify problems by making a QGI evaluation. We have 
reviewed our daily quality control frequency. 

A simple guideline for choosing Westgard rules and levels of 
IQC processed are as follows: for biochemical parameters with 
Sigma Scale 6 or above (excellent performance), evaluate with 
one level of QC per day (alternating levels between days) and 
follow 1-3 s Westgard rule alone. With Sigma Scale 4-6 (good/ 
acceptable performance), evaluate with two levels of control 
once daily and follow 1-3 s, 2-2 s, R4s Westgard multi rules. With 
Sigma Scale 3-4 (poor performance), use two levels of controls 


twice daily and follow 1-3 s, 2-2 s, R4s, and 4-1 s Westgard’s 
multi rules. With the Sigma Scale of <3 (problem analyte), root 
cause analysis should be performed; method performance must 
be improved before the method can be routinely used_[9] 
Finally, sigma metric analysis provides a benchmark for 
the laboratory to design a protocol for IQC, address poor 
assay performance, and assess the efficiency of the existing 
laboratory process. 
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